Skip to content

feat(copy-check): grade handwritten answer sheets with a vision LLM - #2490

Open
neerajhariyale wants to merge 1 commit into
mainfrom
feature/copy-check-vision-grading
Open

feat(copy-check): grade handwritten answer sheets with a vision LLM#2490
neerajhariyale wants to merge 1 commit into
mainfrom
feature/copy-check-vision-grading

Conversation

@neerajhariyale

Copy link
Copy Markdown
Contributor

The copy-check graded PaddleOCR printed-text OCR of handwritten copies and never showed the model the page — capping accuracy at OCR quality. Now rasterize each answer-sheet page and send the image(s) to a vision model (Gemini 2.5 Flash, escalate to 2.5 Pro), with OCR demoted to an assistive hint + annotation anchor. Gated by COPY_CHECK_VISION_GRADING (default on); off = legacy text-only path unchanged. Unrenderable pages route to manual review instead of releasing silent zeros. Callback/JSON contract to assessment_service unchanged.

Summary of Changes

Related Issue

Type of Change

  • Bug fix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update

How Has This Been Tested?

Checklist

  • My code follows the project's style guidelines
  • I have performed a self-review of my code
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing tests pass locally with my changes
  • I have updated the documentation accordingly

The copy-check graded PaddleOCR *printed-text* OCR of *handwritten* copies
and never showed the model the page — capping accuracy at OCR quality.
Now rasterize each answer-sheet page and send the image(s) to a vision
model (Gemini 2.5 Flash, escalate to 2.5 Pro), with OCR demoted to an
assistive hint + annotation anchor. Gated by COPY_CHECK_VISION_GRADING
(default on); off = legacy text-only path unchanged. Unrenderable pages
route to manual review instead of releasing silent zeros. Callback/JSON
contract to assessment_service unchanged.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@codacy-production

Copy link
Copy Markdown
Contributor

Not up to standards ⛔

🔴 Issues 20 minor

Alerts:
⚠ 20 issues (≤ 0 issues of at least minor severity)

Results:
20 new issues

Category Results
Documentation 20 minor

View in Codacy

🟢 Metrics 69 complexity

Metric Results
Complexity 69

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant